Search for: All records

Abstract This study compares real-time forecasts produced by the Warn-on-Forecast System (WoFS) and a hybrid ensemble and variational data assimilation and prediction system (WoF-Hybrid) for 31 events during 2021. Object-based verification is used to quantify and compare strengths and weaknesses of WoFS ensemble forecasts with 3-km horizontal grid spacing and WoF-Hybrid deterministic forecasts with 1.5-km horizontal grid spacing. The goal of such comparison is to provide evidence as to whether WoF-Hybrid has performance characteristics that complement or improve upon those of WoFS. Results indicate that both systems provide similar accuracy for timing and placement of thunderstorm objects identified using simulated reflectivity. WoF-Hybrid provides more accurate forecasts of updraft helicity tracks. Differences in forecast quality are case dependent; the largest difference in accuracy favoring WoF-Hybrid occurs in eight cases identified as “high-impact” by the quantity of National Weather Service Local Storm Reports, while WoFS performance is favored at short lead times for 10 “moderate-” and 13 “low-impact” events. WoF-Hybrid reflectivity objects are closer in size and location to observed objects. However, a higher thunderstorm overprediction bias is identified in WoF-Hybrid, particularly early in the forecast. Two severe weather events are selected for detailed investigation. In the case of 26 May, both systems had similar skill; however, for 10 December, WoF-Hybrid forecasts significantly outperformed WoFS forecasts. These results show improved performance for WoF-Hybrid over WoFS under certain regimes that warrants further investigation. To understand reasons for these differences will help incorporate higher-resolution modeling into Warn-on-Forecast systems. Significance StatementThe NOAA Warn-on-Forecast (WoF) project uses advanced data assimilation for rapidly updating numerical weather prediction systems to provide forecasts of individual thunderstorms. Forecasts show promise for enabling greater warning lead time for some storms. The flagship Warn-on-Forecast System (WoFS) is a 36-member analysis and 18-member forecast system at 3-km grid spacing. The project also produced a single member system that employs variational analysis and produces a deterministic forecast at 1.5-km grid spacing (WoF-Hybrid). This study seeks to evaluate and compare the performance of WoFS and WoF-Hybrid for 31 severe weather events that occurred during 2021. Results found that WoF-Hybrid predicts storm rotation particularly well compared to WoFS, and several other strengths and limitations of both systems are identified. This research may help us understand the complementary nature of two systems and improve our ability to provide more reliable 0–6-h forecasts in the future. 

Abstract Observational data collection is extremely hazardous in supercell storm environments, which makes for a scarcity of data used for evaluating the storm-scale guidance from convection allowing models (CAMs) like the National Oceanic and Atmospheric Administration (NOAA) Warn-on-Forecast System (WoFS). The Targeted Observations with UAS and Radar of Supercells (TORUS) 2019 field mission provided a rare opportunity to not only collect these observations, but to do so with advanced technology: vertically pointing Doppler lidar. One standing question for WoFS is how the system forecasts the feedback between supercells and their near-storm environment. The lidar can observe vertical profiles of wind over time, creating unique datasets to compare to WoFS kinematic predictions in rapidly evolving severe weather environments. Mobile radiosonde data are also presented to provide a thermodynamic comparison. The five lidar deployments (three of which observed tornadic supercells) analyzed show WoFS accurately predicted general kinematic trends in the inflow environment; however, the predicted feedback between the supercell and its environment, which resulted in enhanced inflow and larger storm-relative helicity (SRH), were muted relative to observations. The radiosonde observations reveal an overprediction of CAPE in WoFS forecasts, both in the near and far field, with an inverse relationship between the CAPE errors and distance from the storm. Significance Statement It is difficult to evaluate the accuracy of weather prediction model forecasts of severe thunderstorms because observations are rarely available near the storms. However, the TORUS 2019 field experiment collected multiple specialized observations in the near-storm environment of supercells, which are compared to the same near-storm environments predicted by the National Oceanic and Atmospheric Administration (NOAA) Warn-on-Forecast System (WoFS) to gauge its performance. Unique to this study is the use of mobile Doppler lidar observations in the evaluation; lidar can retrieve the horizontal winds in the few kilometers above ground on time scales of a few minutes. Using lidar and radiosonde observations in the near-storm environment of three tornadic supercells, we find that WoFS generally predicts the expected trends in the evolution of the near-storm wind profile, but the response is muted compared to observations. We also find an inverse relationship of errors in instability to distance from the storm. These results can aid model developers in refining model physics to better predict severe storms. 

Abstract A primary goal of the National Oceanic and Atmospheric Administration Warn-on-Forecast (WoF) project is to provide rapidly updating probabilistic guidance to human forecasters for short-term (e.g., 0–3 h) severe weather forecasts. Postprocessing is required to maximize the usefulness of probabilistic guidance from an ensemble of convection-allowing model forecasts. Machine learning (ML) models have become popular methods for postprocessing severe weather guidance since they can leverage numerous variables to discover useful patterns in complex datasets. In this study, we develop and evaluate a series of ML models to produce calibrated, probabilistic severe weather guidance from WoF System (WoFS) output. Our dataset includes WoFS ensemble forecasts available every 5 min out to 150 min of lead time from the 2017–19 NOAA Hazardous Weather Testbed Spring Forecasting Experiments (81 dates). Using a novel ensemble storm-track identification method, we extracted three sets of predictors from the WoFS forecasts: intrastorm state variables, near-storm environment variables, and morphological attributes of the ensemble storm tracks. We then trained random forests, gradient-boosted trees, and logistic regression algorithms to predict which WoFS 30-min ensemble storm tracks will overlap a tornado, severe hail, and/or severe wind report. To provide rigorous baselines against which to evaluate the skill of the ML models, we extracted the ensemble probabilities of hazard-relevant WoFS variables exceeding tuned thresholds from each ensemble storm track. The three ML algorithms discriminated well for all three hazards and produced more reliable probabilities than the baseline predictions. Overall, the results suggest that ML-based postprocessing of dynamical ensemble output can improve short-term, storm-scale severe weather probabilistic guidance.